Optimisation of on-line principal component analysis

Different techniques, used to optimise on-line principal component analysis, are investigated by methods of statistical mechanics. These include local and global optimisation of node-dependent learning-rates which are shown to be very efficient in speeding up the learning process. They are investigated further for gaining insight into the learning rates' time-dependence, which is then employed for devising simple practical methods to improve training performance. Simulations demonstrate the benefit gained from using the new methods.Comment: 10 pages, 5 figure

Hypervelocity gun

A velocity amplifier system which uses both electric and chemical energy for projectile propulsion is provided in a compact hypervelocity gun suitable for laboratory use. A relatively heavy layer of a tamping material such as concrete encloses a loop of an electrically conductive material. An explosive charge at least partially surrounding the loop is adapted to collapse the loop upon detonation of the charge. A source of electricity charges the loop through two leads, and an electric switch which is activated by the charge explosive charge, disconnects the leads from the source of electricity and short circuits them. An opening in the tamping material extends to the loop and forms a barrel. The loop, necked down in the opening, forms the sabot on which the projectile is located. When the loop is electrically charged and the explosive detonated, the loop is short circuited and collapsed thus building up a magnetic field which acts as a sabot catcher. The sabot is detached from the loop and the sabot and projectile are accelerated to hypervelocity

Phase Transitions of Neural Networks

The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayesian estimate, on-line training, noise estimation and time series generation.Comment: Plenary talk for MINERVA workshop on mesoscopics, fractals and neural networks, Eilat, March 1997 Postscript Fil

Phase transitions in soft-committee machines

Equilibrium statistical physics is applied to layered neural networks with differentiable activation functions. A first analysis of off-line learning in soft-committee machines with a finite number (K) of hidden units learning a perfectly matching rule is performed. Our results are exact in the limit of high training temperatures. For K=2 we find a second order phase transition from unspecialized to specialized student configurations at a critical size P of the training set, whereas for K > 2 the transition is first order. Monte Carlo simulations indicate that our results are also valid for moderately low temperatures qualitatively. The limit K to infinity can be performed analytically, the transition occurs after presenting on the order of N K examples. However, an unspecialized metastable state persists up to P= O (N K^2).Comment: 8 pages, 4 figure

Characterization of vegetation by microwave and optical remote sensing

Two series of carefully controlled experiments were conducted. First, plots of important crops (corn, soybeans, and sorghum), prairie grasses (big bluestem, switchgrass, tal fescue, orchardgrass, bromegrass), and forage legumes (alfalfa, red clover, and crown vetch) were manipulated to produce wide ranges of phytomass, leaf area index, and canopy architecture. Second, coniferous forest canopies were simulated using small balsam fir trees grown in large pots of soil and arranged systematically on a large (5 m) platform. Rotating the platform produced many new canopies for frequency and spatial averaging of the backscatter signal. In both series of experiments, backscatter of 5.0 GHz (C-Band) was measured as a function of view angle and polarization. Biophysical measurements included leaf area index, fresh and dry phytomass, water content of canopy elements, canopy height, and soil roughness and moisture content. For a subset of the above plots, additional measurements were acquired to exercise microwave backscatter models. These measurements included size and shape of leaves, stems, and fruit and the probability density function of leaf and stem angles. The relationships of the backscattering coefficients and the biophysical properties of the canopies were evaluated using statistical correlations, analysis of variance, and regression analysis. Results from the corn density and balsam fir experiments are discussed and analyses of data from the other experiments are summarized

Soybean canopy reflectance modeling data sets

Numerous mathematical models of the interaction of radiation with vegetation canopies have been developed over the last two decades. However, data with which to exercise and validate these models are scarce. During three days in the summer of 1980, experiments are conducted with the objective of gaining insight about the effects of solar illumination and view angles on soybean canopy reflectance. In concert with these experiment, extensive measurements of the soybean canopies are obtained. This document is a compilation of the bidirectional reflectance factors, agronomic, characteristics, canopy geometry, and leaf, stem, and pod optical properties of the soybean canopies. These data sets should be suitable for use with most vegetation canopy reflectance models